AMENDMENT UNDER 37 C.F.R. §1.111 

U.S. Patent Application No.: 09/937,096 Attorney Docket No.: Q64914 

AMENDMENTS TO THE CLAIMS 

This listing of claims will replace all prior versions and listings of claims in the 

application: 

LISTING OF CLAIMS: 

1 . (withdrawn): A method of generating an object oriented interactive multimedia file, 
including: 

encoding data comprising at least one of video, text, audio, music and/or graphics 
elements as a video packet stream, text packet stream, audio packet stream, music packet stream 
and/or graphics packet stream respectively; 

combining said packet streams into a single self-contained object, said object containing 
its own control information; 

placing a plurality of said objects in a data stream; and 

grouping one or more of said data streams in a single contiguous self-contained scene, 
said scene including format definition as the initial packet in a sequence of packets. 

2. (withdrawn): A method of generating an interactive multimedia file according to 
claim 1, including combining one or more of said scenes. 

3. (withdrawn): A method of generating an interactive multimedia file according to 
claim 1 wherein a single scene contains an object library. 
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4. (withdrawn): A method of generating an interactive multimedia file according to 
claim 1 wherein data for configuring customisable decompression transforms is included within 
said objects. 

5. (withdrawn): A method of generating an interactive object oriented multimedia file 
according to claim 1 wherein object control data is attached to objects which are interleaved into 
a video bit stream, and said object control data controls interaction behaviour, rendering 
parameters, composition, and interpretation of compressed data. 

6. (withdrawn): A method of generating an interactive object oriented multimedia file 
according to claim 1 comprising a hierarchical directory structure wherein first level directory 
data comprising scene information is included with the first said scene, second level directory 
data comprising stream information is included with one or more of said scenes, and wherein 
third level directory data comprising information identifying the location of intra-frames is 
included in said data stream. 

7. (withdrawn): A method of generating an object oriented interactive multimedia file, 
including: 

encoding data comprising at least one of video and audio elements as a video packet 
stream and audio packet stream respectively; 

combining said packet streams into a single self-contained object; 
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placing said object in a data stream; 

placing said stream in a single contiguous self-contained scene, said scene including 
format definition; and 

combining a plurality of said scenes. 

8. (withdrawn): A method of generating an interactive object oriented multimedia file 
according to claim 1, wherein said object control data takes the form of messages encapsulated 
within object control packets and represents parameters for rendering video and graphics objects, 
for defining the interactive behaviour of said objects, for creating hyperlinks to and from said 
objects, for defining animation paths for said objects, for defining dynamic media composition 
parameters, for assigning values to user variables, for redirecting or retargeting the consequences 
of interactions with objects and other controls from one object to another, for attaching 
executable behaviours to objects, including voice calls and starting and stop timers, and for 
defining conditions for the execution of control actions. 

9. (withdrawn): A method of generating an interactive object oriented muhimedia file 
according to claim 7, wherein said rendering parameters represent object transparency, scale, 
volume, position, z-order, background colour and rotation, where said animation paths affect any 
of said rendering parameters, said hyperlinks support non-linear video and links to other video 
files, individual scenes within a file, and other object streams within a scene as targets, said 
interactive behaviour data includes the pausing of play and looping play, retuming user 
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information back to the server, activating or deactivating object animations, defining menus, and 
simple forms that can register user selections. 

10. (withdrawn): A method of generating an interactive object oriented multimedia file 
according to claim 7, wherein conditional execution of rendering actions or object behaviours is 
provided and conditions take the form of timer events, user events, system events, interaction 
events, relationships between objects, user variables, and system status such as playing, pausing, 
streaming or stand-alone play. 

11. -12. canceled. 

13. (withdrawn): An interactive multimedia file format comprising single objects 
containing video, text, audio, music, and/or graphical data wherein at least one of said objects 
comprises a data stream, and at least one of said data streams comprises a scene, at least one of 
said scenes comprises a file, and wherein directory data and metadata provide file information. 

14. (withdrawn): A system for dynamically changing the actual content of a displayed 
video in an object-oriented interactive video system comprising: 

a dynamic media composition process including an interactive multimedia file format 
including objects containing video, text, audio, music, and/or graphical data wherein at least one 
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of said objects comprises a data stream, at least one of said data streams comprises a scene, at 
least one of said scenes comprises a file; 

a directory data structure for providing file information; 

selecting mechanism for allowing the correct combination of objects to be composited 
together; 

a data stream manager for using directory information and knowing the location of said 
objects based on said directory information; and 

control mechanism for inserting, deleting, or replacing in real time while being viewed by 
a user, said objects in said scene and said scenes in said video. 

15. (withdrawn): A system according to claim 14 including remote server non- 
sequential access capability, selection mechanism for selecting appropriate data components 
from each object stream, interleaving mechanism for placing said data components into a final 
composite data stream, and v^reless transmission mechanism for sending said final composite 
stream to a client. 

16. (withdrawn): A system according to claim 14 including remote server non- 
sequential access capability, including a mechanism for executing library management 
instructions delivered to said system from said remote server, said server capable of querying 
said library and receiving information about specific objects contained therein, and inserting, 
updating, or deleting the contents of said library; and said dynamic media composition engine 
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capable of sourcing object data stream simultaneously both from said library and remote server 
if required. 

17. (withdrawn): A system according to claim 14 including a local server providing 
offline play mode; 

a storage mechanism for storing appropriate data components in local files; 

selection mechanism for selecting appropriate data components from separate sources; 

a local data file including multiple streams for each scene stored contiguously within said 

file; 

access mechanism for said local server to randomly access each stream within a said 

scene; 

selection mechanism for selecting said objects for rendering; 

a persistent object library for use in dynamic media composition capable of being 
managed from said remote server, said objects capable of being stored in said library with full 
digital rights management information; 

software available to a client for executing library management instructions delivered to 
it from said remote server, said server capable of querying said library and receiving information 
about specific objects contained therein, and inserting, updating, or deleting the contents of said 
library; and 

said dynamic media composition engine capable of sourcing object data stream 
simultaneously both from said library and remote server. 
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18. (withdrawn): A system according to claim 14, wherein each said stream includes an 
end of stream packet for demarcating stream boundaries, said first stream in a said scene 
containing descriptions of said objects within said scene; 

object control packets within said scene provide information for interactivity, changing 
the source data for a particular object to a different stream; 

reading mechanism in said server for reading more than one stream simultaneously from 
within a said file when performing local playback; and 

mechanism for managing an array or linked list of streams, data stream manager capable 
of reading one packet from each stream in a cyclical manner; storage mechanism for storing the 
current position in said file; and storage mechanism for storing a list of referencing objects. 

19. (withdrawn): A system according to claim 14, wherein data is streamed to a media 
player client, said client capable of decoding packets received fi-om the remote server and 
sending back user operations to said server, said server responding to user operations such as 
clicking, and modifying said data sent to said client, each said scene containing a single 
multiplexed stream composed of one or more objects, said server capable of composing scenes in 
real-time by multiplexing multiple object data streams based on client requests to construct a 
single multiplexed stream for any given scene, and wireless streaming to said client for playback. 

20. (withdravm): A system according to claim 14 including playing mechanism for 
playing a plurality of video objects simultaneously, each of said video objects capable of 
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originating from a different soxxrce, said server capable of opening each of said sources, 
interleaving the bit streams, adding appropriate control information and forwarding the nev^ 
composite stream to said client. 

21. (Mdthdrawn): A system according to claim 14 including a data source manager 
capable of randomly accessing said source file, reading the correct data and control packets from 
said streams which are needed to compose the display scene, and including a server multiplexer 
capable of receiving input from multiple source manager instances v^th single inputs and from 
said dynamic media composition engine, said multiplexer capable of multiplexing together 
object data packets from said sources and inserting additional control packets into said data 
stream for controlling the rendering of component objects in the composite scene. 

22 (v^thdrawn): A system according to claims 14 including an XML parser to enable 
programmable control of said dynamic media composition through lAVML scripting. 

23. (withdrawn): A system according to claims 14, wherein said remote server is 
capable of accepting a number of inputs from the server operator to fiirther control and 
customize said dynamic media composition process, said inputs including user profile, 
demographics, geographic location, or the time of day. 
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24. (withdrawn): A system according to claims 14, wherein said remote server is 
capable of accepting a number of inputs from the server operator to further control and 
customize said dynamic media composition process, said inputs including a log of user 
interaction such as knowledge of what advertisements have success with a user. 

25. (withdrawn): An object oriented interactive multimedia file, comprising: 
a combination of one or more of contiguous self-contained scenes; 

each said scene comprising scene format definition as the first packet, and a group of one 
or more data streams follov^ng said first packet; 

each said data stream apart fi-om first data stream containing objects which may be 
optionally decoded and displayed according to a dynamic media composition process as 
specified by object control information in said first data stream; and 

each said data stream including one or more single self-contained objects and demarcated 
by an end stream marker; said objects each containing it's own control information and formed 
by combining packet streams; said packet streams formed by encoding raw interactive 
multimedia data including at least one or a combination of video, text, audio, music, or graphics 
elements as a video packet stream, text packet stream, audio packet stream, music packet stream 
and graphics packet stream respectively. 

26. (withdravm): An object-oriented interactive video system including an interactive 
multimedia file format according to claim 25 including: 
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server software for performing said dynamic media composition process, said process 
allowing the actual content of a displayed video scene to be changed dynamically in real-time 
while a user views said video scene, and for inserting, replacing, or adding any of said scene's 
arbitrary shaped visual/audio video objects; and 

a control mechanism to replace in-picture objects by other objects to add or delete in- 
picture objects to or from a current scene to perform said process in a fixed, adaptive, or user- 
mediated mode. 

27. (v^thdravra): An object oriented interactive multimedia file according to claim 25 
including data for configuring customisable decompression transforms within said scenes. 

28. (withdrawn): An object-oriented interactive video system including an interactive 
multimedia file fomiat according to claim 25 including: 

a control mechanism to provide a local object library to support said process, said library 
including a storage means for storing objects for use in said process, control mechanism to 
enable management of said library fi-om a streaming server, control mechanism for providing 
versioning control for said library objects, and for enabling automatic expiration of non 
persistent library objects; and 

control mechanism for updating objects automatically fi-om said server, for providing 
muhilevel access control for said library objects, and for supporting a unique identity, history 
and status for each of said library objects. 
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29. (withdrawn): An object-oriented interactive video system including an interactive 
multimedia file format according to claim 25 including: 

a control mechanism for responding to a user click on a said object in a session by 
immediately performing said dynamic media composition process; and 

control mechanism for registering a user for offline follow-up actions, and for moving to 
a new hyperlink destination at the end of said session. 

30. (withdrawn): A method of real-time streaming of file data in the object oriented file 
format according to claim 25, over a wireless network whereby a scene includes only one stream, 
and said dynamic media composition engine interleaves objects from other streams at an 
appropriate rate into the said first stream. 

3 1 . (withdrawn): A method of real-time streaming of file data in the object oriented file 
format according to claim 25, over a wireless network whereby a scene includes only one stream, 
and said dynamic media composition engine interleaves objects from other streams at an 
appropriate rate into the said first stream. 

32. (withdrawn): A method according to claim 30 of streaming live video content to a 
user where said other streams include streams which are encoded in real time. 
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33. (withdrawn): A method according to claim 3 1 of streaming live video content to a 
user comprising the following steps: 

said user connecting to a remote server; and 

said user selecting a camera location to view within a region handled by the 
operator/exchange; 

34. (withdrawn): A method according to claim 3 1 of streaming live video content to a 
user comprising the following steps: 

said user connects to a remote server; and 

said user's geographic location, derived from a global positioning system or cell 
triangulation, is used to automatically provide a selection of camera locations to view for 
assistance with said user's selection of a destination . 

35. (withdrawn): A method according to claim 31 of streaming live traffic video content 
to a user comprising the following steps: 

said user registers for a special service where a service provider calls said user and 
automatically streams video showing a motorist's route that may have a potential problem area; 

upon registering said user may elect to nominate a route for this purpose, and may assist 
with determining said route; and 

said system tracks said user's speed and location to determine the direction of travel and 
route being followed, said system could then search its list of monitored traffic cameras along 
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potential routes to determine if any sites are problem areas, and if any problems exist, said 
system notifies said user and plays a video to present the traffic information and situation. 

36. (withdrawn): A method of advertising according to claim 26, wherein said dynamic 
media composition process selects objects based on a subscriber's own profile information, 
stored in a subscriber profile database. 

37. (withdrawn): A method of providing a voice command operation of a low power 
device capable of operating in a streaming video system, comprising the following steps: 

capturing a user's speech on said device; 
compressing said speech; 

inserting encoded samples of said compressed speech into user control packets; 
sending said compressed speech to a server capable of processing voice commands; 
said server performs automatic speech recognition; 
said server maps the transcribed speech to a command set; 
said system checks whether said command is generated by said user or said server; 
if said transcribed command is from said server, said server executes said command; 
if said transcribed command is from said user said system forwards said conmiand to said 
user device; and 

said user executes said conmiand. 
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38. (withdrawn): A method of providing a voice command operation of a low power 
device capable of operating in a streaming video system, according to claim 37, wherein: 

said system determines whether transcribed command is pre-defined; 
if said transcribed command is not pre-defined, said system sends said transcribed text 
string to said user; and 

said user inserts said text string into an appropriate text field, 

39. -68. canceled. 

69. (withdrawn): A method of processing objects, comprising the steps of: 
parsing information in a script language; 

reading a plurality of data sources containing a plurality of objects in the form of at least 
one of video, graphics, animation, and audio; 

attaching control information to the plurality of objects based on the information in the 
script language; and 

interleaving the plurality of objects into at least one of a data stream and a file. 

70. (withdrawn): A method according to claim 69, further comprising the step of 
inputting information from a user, wherein the step of attaching is performed based on the 
information in the script language and the information fi-om the user. 
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71 . (withdrawn): A method according to claim 69, further comprising the step of 
inputting control information selected from at least one of profile information, demographic 
information, geographic information, and temporal information, wherein the step of attaching is 
performed based on the information in the script language and the control information. 

72. (withdrawn): A method according to claim 71, further comprising the step of 
inputting information from a user, wherein the step of attaching is performed based on the 
information in the script language, the control information, and the information from the user. 

73. (withdrawn): A method according to claim 72, wherein the step of inputting 
information from the user comprises graphically pointing and selecting an object on a display. 

74. (withdrawn): A method according to claim 69, further comprising the steps of 
inserting an object into the at least one of the data stream and file. 

75. (withdrawn): A method according to claim 74, wherein said inserting step comprises 
inserting an advertisement into the at least one of the data stream and file. 

76. (withdrawn): A method according to claim 75, fiirther comprising the step of 
replacing the advertisement with a different object. 
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77. (withdravm): A method according to claim 74, wherein said inserting step comprises 
inserting a graphical character into the at least one of the data stream and file. 

78. (withdrawn): A method according to claim 77, wherein said step of inserting a 
graphical character comprises inserting the graphical character based on a geographical location 
of a user. 

79. (withdrawn): A method according to claim 69, further comprising the step of 
replacing one of the plurality of objects with another object. 

80. (withdrawn): A method according to claim 79, wherein said step of replacing one of 
the plxirality of objects comprises replacing the one of the plurality of objects which is a viewed 
scene with a new scene. 

81. (withdrawn): A method according to claim 69, wherein said step of reading a 
plurality of data sources comprises reading a least one of the plurality of data sources which is 
training video. 

82. (withdrawn): A method according to claim 69, wherein said step of reading a 
plurality of data sources comprises reading a least one of the plurality of data sources which is an 
educational video. 
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83. (withdrawn): A method according to claim 69, wherein said step of reading a 
plurality of data sources comprises reading a least one of the plurality of data sources which is a 
promotional video. 

84. (withdrawn): A method according to claim 69, wherein said step of reading a 
plurality of data sources comprises reading a least one of the plurality of data sources which is an 
entertainment video. 

85. (withdrawn): A method according to claim 69, wherein said step of reading a 
plurality of data sources comprises obtaining video from a surveillance camera. 

86. (withdrawn): A method according to claim 74, wherein said inserting step comprises 
inserting a video from a camera for viewing automobile traffic into the at least one of the data 
stream and file. 

87. (withdrawn): A method according to claim 74, wherein said inserting step comprises 
inserting information of a greeting card into the at least one of the data stream and file. 

88. (v^thdrawn): A method according to claim 74, wherein said inserting step comprises 
inserting a computer generated image of a monitor of a remote computing device. 
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89. (withdrawn): A method according to claim 69, further comprising the step of 
providing the at least one of a data stream and a file to a user, wherein the at least one of a data 
stream and a file include an interactive video brochure. 

90. (withdrawn): A method according to claim 69, fiirther comprising the step of 
providing the at least one of a data stream and a file which includes an interactive form to a user; 

electronically filling out the form by the user; and 

electronically storing information entered by the user when filling out the form. 

91. (withdrawn): A method according to claim 90, fiirther comprising the step of 
transmitting the information which has been electronically stored. 

92. (v^thdrawn): A method according to claim 69, wherein the step of attaching control 
information comprises attaching control information which indicates interaction behaviour. 

93. (withdrawn): A method according to claim 69, wherein the step of attaching control 
information comprises attaching control information which includes rendering parameters. 

94. (withdrawn): A method according to claim 69, wherein the step of attaching control 
information comprises attaching control information which includes composition information. 
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95. (withdrawn); A method according to claim 69, wherein the step of attaching control 
information comprises attaching control information which indicates how to process compressed 
data. 

96. (withdrawn): A method according to claim 69, wherein the step of attaching control 
information comprises attaching an executable behaviour. 

97. (withdrawn): A method according to claim 96, wherein the step of attaching an 
executable behaviour comprises attaching rendering parameters used for animation. 

98. (withdrawn): A method according to claim 96, wherein the step of attaching an 
executable behaviour comprises attaching a hyperlink. 

99. (withdrawn): A method according to claim 96, wherein the step of attaching an 
executable behaviour comprises attaching a timer. 

100. (withdrawn): A method according to claim 96, wherein the step of attaching an 
executable behaviour comprises attaching a behaviour which allows making a voice call. 

101. (withdrawn): A method according to claim 96, wherein the step of attaching an 
executable behaviour comprises attaching systems states including at least one of pause and play. 
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102. (withdrawn): A method according to claim 96, wherein the step of attaching an 
executable behaviour comprises attaching information which allows changing of user variables. 

103. (v^thdravra): A system for processing objects, comprising: 
means for parsing information in a script language; 

means for reading a plurality of data sources containing a plurality of objects in the form 
of at least one of video, graphics, animation, and audio; 

means for attaching control information to the plurality of objects based on the 
information in the script language; and 

means for interleaving the plurality of objects into at least one of a data stream and a file. 

104. (withdrawn): A system according to claim 103, further comprising means for 
inputting information fi:om a user, wherein the means for attaching operates based on the 
information in the script language and the information from the user. 

105. (v^thdravm): A system according to claim 103, further comprising means for 
inputting control information selected from at least one of profile information, demographic 
information, geographic information, and temporal information, wherein the means for attaching 
operates based on the information in the script language and the control information. 
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106. (withdrawn): A system according to claim 105, further comprising means for 
inputting information from a user, wherein the means for attaching operates based on the 
information in the script language, the control information, and the information from the user. 

107. (withdrawn): A system according to claim 106, wherein the means for inputting 
information from the user comprises means for graphically pointing and selecting an object on a 
display. 

108. (withdrawn): A system according to claim 103, fiirther comprising means for 
inserting an object into the at least one of the data stream and file. 

109. (withdrawn): A system according to claim 108, wherein said means for inserting 
comprises means for inserting an advertisement into the at least one of the data stream and file. 

110. (withdrawn): A system according to claim 109, fiirther comprising means for 
replacing the advertisement with a different object. 

111. (withdrawn): A system according to claim 108, wherein said means for inserting 
comprises means for inserting a graphical character into the at least one of the data stream and 
file. 
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1 12. (withdravm): A system according to claim 111, wherein said means for inserting a 
graphical character comprises means for inserting the graphical character based on a 
geographical location of a user. 

113. (withdrawn): A system according to claim 103, further comprising means for 
replacing one of the plurality of objects with another object. 

1 14. (withdrawn): A system according to claim 113, wherein said means for replacing 
one of the plurality of objects comprises means for replacing the one of the plurality of objects 
which is a viewed scene with a new scene. 

115. (withdrawn): A system according to claim 103, wherein said means for reading a 
pluraUty of data sources comprises means for reading a least one of the plurality of data sources 
which is a training video. 

1 16. (withdrawn): A system according to claim 103, wherein said means for reading a 
plurality of data sources comprises means for reading a least one of the plurality of data sources 
which is a promotional video. 
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117. (withdrawn): A system according to claim 103, wherein said means for reading a 
plurality of data sources comprises means for reading a least one of the plurality of data sources 
which is an entertainment video. 

118. (withdrawn): A system according to claim 103, wherein means for reading a 
plurality of data sources comprises means for reading a least one of the plurality of data sources 
which is an educational video. 

119. (withdrawn): A system according to claim 103, wherein said means for reading a 
plurality of data sources comprises means for obtaining video from a surveillance camera. 

120. (withdrawn): A system according to claim 107, wherein said means for inserting 
comprises means for inserting a video from a camera for viewing automobile traffic into the at 
least one of the data stream and file. 

121. (withdrawn): A system according to claim 107, wherein said means for inserting 
comprises means for inserting information of a greeting card into the at least one of the data 
stream and file. 

122. (withdrawn): A system according to claim 107, wherein said means for inserting 
comprises inserting a computer generated image of a monitor of a remote computing device. 
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123. (withdrawn): A system according to claim 103, further comprising means for 
providing the at least one of a data stream and a file to a user, wherein the at least one of a data 
stream and a file includes an interactive video brochure. 

124. (v^thdrawn): A system according to claim 103, fiirther comprising means for 
providing the at least one of a data stream and a file which includes an interactive form to a user; 

means for electronically filling out the form by the user; and 

means for electronically storing information entered by the user when filling out the 

form. 

125. (v^thdrawn): A system according to claim 124, further comprising means for 
transmitting the information which has been electronically stored. 

126. (withdravm): A system according to claim 103, wherein the means for attaching 
control information comprises means for attaching control information which indicates 
interaction behaviour. 

127. (withdrawn): A system according to claim 103, wherein the means for attaching 
control information comprises means for attaching control information which includes rendering 
parameters. 
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128. (withdrawn): A system according to claim 103, wherein the means for attaching 
control information comprises means for attaching control information which includes 
composition information. 

129. (withdrawn): A system according to claim 103, wherein the means for attaching 
control information comprises means for attaching control information which indicates how to 
process compressed data. 

130. (withdrawn): A system according to claim 103, wherein the means for attaching 
control information comprises means for attaching an executable behaviour. 

131. (withdrawn): A system according to claim 130, wherein the means for attaching an 
executable behaviour comprises means for attaching rendering parameters used for animation. 

132. (withdrawn): A system according to claim 130, wherein the means for attaching an 
executable behaviour comprises means for attaching a hyperlink. 

133. (withdrawn): A system according to claim 130, wherein the means for attaching an 
executable behaviour comprises means for attaching a timer. 
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134. (withdrawn): A system according to claim 130, wherein the means for attaching an 
executable behaviour comprises means for attaching a behaviour which allows making a voice 
call. 

135. (withdrawn): A system according to claim 130, wherein the means for attaching an 
executable behaviour comprises means for attaching systems states including at least one of 
pause and play. 

136. (withdrawn): A system according to claim 130, wherein the means for attaching an 
executable behaviour comprises means for attaching information which allows changing of user 
variables. 

137. -144. canceled. 

145. (withdrawn): A method of transmitting an electronic greeting card, comprising the 
steps of: 

inputting information indicating features of a greeting card; 
generating image information corresponding to the greeting card; 
encoding the image information as an object having control information; 
transmitting the object having the control information over a wireless connection; 
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receiving the object having the control information by a wireless hand-held computing 

device; 

decoding the object having the control information into a greeting card image by the 
wireless hand-held computing device; and 

displaying the greeting card image which has been decoded on the hand-held computing 

device. 

146. (withdrawn): A method according to claim 145, wherein the step of generating 
image information comprises capturing at least one of an image and as series of images as 
custom image information, wherein the encoding step further comprises encoding said custom 
image as an object having control information, wherein said step of decoding comprises 
decoding the object encoded using the image information and decoding the object encoded using 
the custom image information, wherein said displaying step comprises displaying image 
information and the custom image information as the greeting card. 

147. (withdrawn): A system transmitting an electronic greeting card, comprising: 
means for inputting information indicating features of a greeting card; 

means for generating image information corresponding to the greeting card; 
means for encoding the image information as an object having control information; 
means for transmitting the object having the control information over a wireless 
connection; 
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means for receiving the object having the control information by a wireless hand-held 
computing device; 

means for decoding the object having the control information into a greeting card image 
by the wireless hand-held computing device; and 

means for displaying the greeting card image which has been decoded on the hand-held 
computing device. 

148. (withdrawn): A system according to claim 147, wherein the means for generating 
image information comprises means for capturing at least one of an image and as series of 
images as custom image information, wherein the means for encoding further comprises means 
for encoding said custom image as an object having control information, wherein said means for 
decoding comprises means for decoding the object encoded using the image information and 
decoding the object encoded using the custom image information, wherein said means for 
displaying comprises means for displaying image information and the custom image information 
as the greeting card. 

149. -182. canceled. 

183. (withdrawn): An object oriented muUimedia video system capable of supporting 
multiple arbitrary shaped video objects without the need for extra data overhead or processing 
overhead to provide video object shape information. 
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1 84. (withdrawn): A system according to claim 1 83, wherein said video objects have 
their own attached control information. 

185. (withdrawn): A system according to claim 183, wherein said video objects are 
streamed from a remote server to a client. 

186. (withdrawn): A system according to claim 183, wherein said video object shape is 
intrinsically encoded in the representation of the images. 

187. (withdrawn): A method according to claim 69, wherein the step of attaching 
control information comprises attaching conditions for execution of controls. 

188. (withdrawn): A method according to claim 71 further comprising the steps of 
obtaining information from user flags or variables, wherein the step of attaching is performed 
based on the information in the script language, the control information, and the information 
from said user flags. 

189. -192. canceled. 
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193. (withdrawn): A method according to claim 69, wherein said step of reading a 
plurality of data sources comprises reading a least one of the plurality of data sources which take 
the form of marketing, promotional, product information, entertainment videos videos. 

194. -199. canceled. 

200. (withdrawn): A system according to claim 14 including a persistent object library 
on a portable client device for use in dynamic media composition said library being capable of 
being managed from said remote server, software available to a client for executing library 
management instructions delivered to it from said remote server, said server capable of querying 
said library and receiving information about specific objects contained therein, and inserting, 
updating, or deleting the contents of said library; and said dynamic media composition engine 
capable of sourcing object data stream simultaneously both from said library and remote server, 
if required, said persistent object library storing object information including expiry dates, access 
permissions, unique identifiers, metadata and state information, said system performing 
automatic garbage collection on expired objects, access control, library searching, and various 
other library management tasks. 

201. (currently amended): A video encoding method, including: 
encoding video data with object control data as a video object; and 
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generating a data stream including a plurality of smd video objects with respective video 
data and object control data. 

202. (original): A video encoding method as claimed in claim 201, including: 
generating a scene packet representative of a scene and including a plurality of said data 

stream with respective video objects. 

203. (original): A video encoding method as claimed in claim 202, including generating 
a video data file including a plurality of said scene packet v^th respective data streams and user 
control data. 

204. (original): A video encoding method as claimed in claim 201, wherein said video 
data represents video frames, audio fi-ames, text and/or graphics. 

205. (original): A video encoding method as claimed in claim 201, wherein said video 
object comprises a packet with data packets of said encoded video data and at least one object 
control packet with said object control data for said video object. 

206. (original): A video encoding method as claimed in claim 202, wherein said video 
data file, said scene packets and said data streams include respective directory data. 
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207. (original): A video encoding method as claimed in claim 201, wherein said object 
control data represents parameters defining said video object to allow interactive control of said 
object within a scene by a user. 

208. (original): A video encoding method as claimed in claim 201, wherein said 
encoding includes encoding luminance and colour information of said video data with shape data 
representing the shape of said video object. 

209. (original): A video encoding method as claimed in claim 201, wherein said object 
control data defines shape, rendering, animation and interaction parameters for said video 
objects. 

210. (currently amended): A video encoding method, including: 

quantising colour data in a video stream based on a reduced representation of colours; 
generating encoded video frame data representing said quantised colours and transparent 
regions; and 

generating encoded audio data and object control data for transmission with said encoded 
video dat a as a video object . 

211. (original): A video encoding method as claimed in claim 210, including: 
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generating motion vectors representing colour changes in a video frame of said stream; 
said encoded video frame data representing said motion vectors. 

212. (original): A video encoding method as claimed in claim 211, including: 
generating encoded text object and vector graphic object and music object data for 

transmission with said encoded video data; and 

generating encoded data for configuring customisable decompression transformations. 

213. (currently amended): A video encoding method as claimed in claim 202, including 
dynamically generating said scene packets for a user in real-time based on user interaction with 
said video objects. 

214. (currently amended): A video encoding method as claimed in claim 201, wherein 
said object control data represents parameters for (i) rendering video objects, for (ii) defining the 
interactive behaviour of said objects, for (iii) creating hyperlinks to and from said objects, for 
(iv) defining animation paths for said objects, for (v) defining dynamic media composition 
parameters, for (vi) assigning of values to user variables and/or for (vii) defining conditions for 
execution of control actions. 

215. (original): A video encoding method as claimed in claim 210 or 21 1, wherein said 
object control data represents parameters for rendering objects of a video frame. 
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216. (original): A video encoding method as claimed in claim 210 or 21 1, wherein said 
parameters represents transparency, scale, volume, position, and rotation. 

217. (original): A video encoding method as claimed in claim 210 or 21 1, wherein said 
encoded video, audio and control data are transmitted as respective packets for respective 
decoding. 

218. (original): A video encoding method, including: 

(i) selecting a reduced set of colours for each video frame of video data; 

(ii) reconciling colours from frame to frame; 

(iii) executing motion compensation; 

(iv) determining update areas of a frame based on a perceptual colour 
difference measure; 

(v) encoding video data for said frames into video objects based on steps (i) to 
(iv); and 

(vi) including in each video object animation, rendering and dynamic 
composition controls. 

219. (withdravra): A video decoding method for decoding video data encoded according 
to a method as claimed in any one of the preceding claims. 



35 



AMENDMENT UNDER 37 C.F.R. §1.111 
U.S. Patent Application No.: 09/937,096 



Attorney Docket No.: Q64914 



220. (withdrawn): A video decoding method as claimed in claim 219, including parsing 
said encoded data to distribute object control packets to an object management process and 
encoded video packets to a video decoder. 

221. (original): A video encoding method as claimed in claim 214, wherein said 
rendering parameters represent object transparency, scale, volume, position and rotation. 

222. (original): A video encoding method as claimed in claim 214, wherein said 
animation paths adjust said rendering parameters. 

223. (original): A video encoding method as claimed in claim 214, wherein said 
hyperlinks represent links to respective video files, scene packets and objects. 

224. (original): A video encoding method as claimed in claim 214, wherein said 
interactive behaviour data provides controls for play of said objects, and return of user data. 

225. (withdravm): A video decoding method as claimed in claim 220 including 
generating video object controls for a user based on said object control packets for received and 
rendered video objects. 
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226. (withdrawn): A video decoder having components for executing the steps of the 
video decoding method as claimed in claim 219. 

227. (withdrawn): A computer device having a video decoder as claimed in claim 226. 

228. (withdrawn): A computer device as claimed in claim 227, wherein said device is 
portable and handheld, such as a mobile phone or PDA. 

229. (currently amended): A dynamic colour space encoding method including 
executing the video encoding method as claimed in claim 201 and adding additional colour 
quantisation information for transmission to a user to enable said user to select a real-time colour 
reduction. 

230. (original): A video encoding method as claimed in claim 201, including adding 
targeted user and/or local video advertising with said video object. 

23 1 . (withdrawn): A computer device having an ultrathin client for executing the video 
decoding method as claimed in claim 219 and adapted to access a remote server including said 
video objects. 
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232. (withdrawn): A method of multivideo conferencing including executing the video 
encoding method as claimed in claim 201 . 

233. (original): A video encoding method as claimed in claim 201, including generating 
video menus and forms for user selections for inclusion in said video objects. 

234. (withdrawn): A method of generating electronic cards for transmission to mobile 
phones including executing said video encoding method as claimed in claim 201. 

235. (original): A video encoder having components for executing the steps of the video 
encoding method as claimed in any one of claims 201 to 218. 

236. (withdravm): A video on demand system including a video encoder as claimed in 
claim 235. 

237. (withdravm): A video security system including a video encoder as claimed in 
claim 235. 

238. (withdrawn): An interactive mobile video system including a video decoder as 
claimed in claim 226. 
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239. (withdrawn): A video decoding method as claimed in 219 including processing 
voice commands from a user to control a video display generated on the basis of said video 
objects. 

240. (withdrawn): A computer program stored on a computer readable storage medium 
including code for executing a video decoding method as claimed in claim 219 and generating a 
video display including controls for said video objects, and adjusting said display in response to 
application of said controls. 

241. (withdrawn): A computer program as claimed in claim 240 including lAVML 
instructions. 

242. (withdrawn): A wireless streaming video and animation system, including: 

(i) a portable monitor device and first wireless communication means; 

(ii) a server for storing compressed digital video and computer animations and 
enabling a user to browse and select digital video to view from a library of 
available videos; and 

(iii) at least one interface module incorporating a second wireless 
communication means for transmission of transmittable data from the 
server to the portable monitor device, the portable monitor device 
including means for receiving said transmittable data, converting the 
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transmittable data to video images displaying the video images, and 
pemiitting the user to communicate with the server to interactively browse 
and select a video to view. 



243. (withdrawn): A wireless streaming video and animation system as claimed in claim 
242, wherein said portable wireless device is a hand held processing device. 



244. (withdrawn): A method of providing wireless streaming of video and animation 
including at least one of the steps of: 

(a) downloading and storing compressed video and animation data from a remote 
server over a wide area network for later transmission from a local server; 

(b) permitting a user to browse and select digital video data to view from a library of 
video data stored on the local server; 

(c) transmitting the data to a portable monitor device; and 

(d) processing the data to display the image on the portable monitor device. 

245. (withdrawn): A method of providing an interactive video brochure including at 
least one of the steps of: 

(a) creating a video brochure by specifying (i) the various scenes in the brochure and 
the various video objects that may occur within each scene, (ii) specifying the 
preset and user selectable scene navigational controls and the individual 
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composition rules for each scene, (iii) specifying rendering parameters on media 
objects, (iv) specifying controls on media objects to create forms to collect user 
feedback, (v) integrating the compressed media streams and object control 
information into a composite data stream. 

246. (withdrawn): A method as claimed in claim 245, including: 

(a) processing the composite data stream and interpreting the object control 
information to display each scene; 

(b) processing user input to execute any relevant object controls, such as navigation 
through the brochure, activating animations etc, registering and user selections 
and other user input; 

(c) storing the user selections and user input for later uploading to the provider of the 
video brochures network server when a network connection becomes available; 
and 

(d) at a remote network server, receiving uploads of user selections from interactive 
video brochures and processing the information to integrate it into a 
customer/client database. 

247. canceled. 
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248. (original): A video encoding method as claimed in claim 201, wherein said object 
control data includes shape parameters that allow a user to render arbitrary shape video 
corresponding to said video object. 

249. (original): A video encoding method as claimed in claim 201, wherein said object 
control data includes condition data determining when to invoke corresponding controls for said 
video object. 

250. (original): A video encoding method as claimed in claim 201, wherein said object 
control data represents controls for affecting another video object. 

251. (currently amended): A video encoding method as claimed in claim 201, including 
controlling dynamic media composition of said video objects on the basis of at least one state 
flags set in response to events or user interactions 

252. (original): A video encoding method as claimed in claim 201 , including 
broadcasting and/or multicasting said data stream. 
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